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Pair-by-Pair  Preferences 


LEARNING  INCENTIVES  PREFERRED  BY  UNIVERSITY  STUDENTS 


Introduction 

What  motivates  a student  to  try  hard  in  a course?  Is  it  primarily 
the  prospect  of  the  final  course  grade?  What  other  factors  under  the 
control  of  the  instructor  are  potentially  effective  incentives?  Answers 
to  such  questions  are  important  because  they  enable  an  instructor  to  select 
incentives  and  design  strategies  for  promoting  student  effort  and  achieve- 
ment. 

Instructors  differ  considerably  in  their  attempts  to  influence 
students  to  perform  well  in  their  courses.  Many  instructors  offer  incen- 
tives in  addition  to  grades  for  good  performance,  while  others  do  not.  A 
frequent  practice  in  secondary  schools  is  to  release  students  from  the 
final  examination  for  a semester  if  they  have  maintained  a given  grade- 
point  average  during  the  semester.  In  many  personalized  system  of  instruc- 
tion (PSI)  courses,  high-achieving  students  are  offered  the  opportunity 
to  serve  as  course  proctors.  Students  who  complete  a given  number  of 
lessons  ahead  of  schedule  in  a computer  assisted  instruction  course  at 
the  University  of  Illinois  (Anderson,  1975)  are  given  first  choice  among 
a selection  of  seminars  included  in  the  course.  Positive  comments  (Page, 
1958)  and  bonus  points  toward  a grade  are  other  commonly  used  incentives. 

The  effect  of  an  incentive  on  student  achievement  appears  to  be 
closely  related  to  the  student's  perception  of  the  desirability  of  the 
incentives  (Sullivan,  Schutz,  & Baker,  1971).  Until  recently,  however, 
no  data  were  available  on  the  preferences  of  students  for  incentives  that 
are  commonly  available  for  use  by  an  instructor.  A recent  survey  (Bebeau, 
Eubanks,  & Sullivan,  1976)  of  369  college  freshmen  in  an  introductory 
psychology  course  revealed  that  release  from  the  course  final  examination 
was  the  most  preferred  of  nine  such  commonly  available  incentives. 
"Assisting  the  instructor  as  a proctor"  was  the  least  preferred  incentive, 
ranking  just  above  "no  reward  at  all." 

The  present  study  was  conducted  to  determine  the  preferences  of 
upper-division  undergraduate  students  in  a College  of  Education  for  incen- 
tives commonly  available  for  use  by  an  instructor.  The  study  involved  an 
extension  of  the  data  base  from  the  incentive  preference  survey,  cited 
previously,  to  a different  sample  of  university  students.  It  was  planned 
that  data  from  the  present  study  would  subsequently  be  used  to  select  most 
preferred  and  least  preferred  incentives  for  experimental  investigations 
of  their  effects  on  the  achievement  of  College  of  Education  students.  Air 
Force  training  programs  frequently  use  extrinsic  incentives  and  competition 
(e.g.,  class  standing)  as  motivators.  This  basic  research,  while  dealing 
with  incentives  somewhat  different  than  those  used  in  Air  Force  training, 
is  directed  toward  developing  how  these  types  of  incentives  function  and 
how  they  might  be  employed  more  effectively. 
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Method 


Subjects 


The  sample  consisted  of  385  education  majors,  125  males  and  260 
females,  enrolled  in  several  different  courses  in  the  College  of  Education 
at  Arizona  State  University. 


Instrument 

The  two-part  incentive  preference  scale  used  in  the  Bebeau,  Eubanks 
and  Sullivan  study  (1976)  was  used  for  data  collection  purooses.  The 
first  part  of  the  scale  requires  students  to  rank  incentives  on  a paired- 
comparison  basis.  For  each  of  the  45  paired-comparison  items,  students 
select  the  incentive  most  preferred  as  a reward  for  doing  good  work.  On 
the  second  part  of  the  scale,  students  rate  each  incentive  using  a seven- 
point  scale  with  the  following  directions: 

Circle  the  number  which  represents  how  you  would  feel  if 

each  method  described  were  used  to  motivate  you  to  do  your 

best  in  a course. 

The  incentives  used  to  form  the  scale  are: 

(1)  release  from  taking  a final  examination, 

(2)  release  from  attending  future  class  sessions, 

(3)  receiving  a letter  grade  indicating  the  quality  of  work, 

(4)  receiving  points  toward  a course  grade, 

(5)  having  work  recognized  in  department  publications, 

(6)  assisting  the  instructor  as  proctor, 

(7)  receiving  positive  comments  from  the  instructor, 

(8)  participating  in  a group  discussion  with  an  authority  on  a 

class  topic, 

(9)  participating  in  course-related  field  trips,  and 

(10)  no  reward  at  all . 


Procedures 

The  scale  was  administered  to  intact  groups  of  students  enrolled 
in  education  courses  during  regularly  scheduled  class  periods.  All 
students  present  in  each  session  voluntarily  completed  the  incentive  ore 
ference  scale  in  approximately  10  minutes.  Students  completed  the  scale 
four  weeks  before  the  end  of  the  soring  semester. 


Results 


Paired  Comparisons 

Figure  1 shows  a graphic  representation  of  scale  values,  using  the 
Case  V model  (Edwards,  1957) 'obtained  for  each  incentive  from  the  45  paired 
comparison  items.  As  with  an  earlier  ranking  by  introductory  psychology 
students,  "release  from  final  examination"  was  by  far  the  most  preferred 
incentive.  "No  reward  at  all"  was  least  preferred,  and  "assisting  the 
instructor  as  proctor"  again  ranked  just  above  it  in  ninth  position. 

Ratings  for  each  incentive  on  a pair-by-pair  basis,  along  with  the  dis- 
criminal  dispersion  for  each  incentive,  are  shown  in  Table  1. 

The  between -subject  consistency  of  paired -comparison  ratings  (i.e., 
the  degree  to  which  subjects  showed  the  same  preference  pattern)  is  indi- 
cated by  u^,  the  coefficient  of  agreement.  Kendall's  Test  was  employed  to 
test  the  obtained  coefficient  of  .2228  for  significance.  The  resulting 
x2  of  3915.7,  ^ = 45,  £ < .0000  revealed  that  the  agreement  among  raters 
was  highly  significant. 

The  wi thin-subject  consistency  of  ratings  is  indicated  by  the  per- 
centage of  subjects  who  obtained  significant  coefficients  of  consistency 
(zeta).  Ninety  percent  of  the  subjects  had  zeta  values  greater  than  .80, 

£ < .0005,  and  only  one  subject  had  a value  less  than  .45,  £ < .05. 
Within-subject  ratings  on  the  paired  comparison,  therefore,  were  highly 
consistent. 

The  Pearson  product-moment  correlation  between  the  scale  values 
obtained  from  the  present  sample  of  education  students  and  the  earlier 
sample  of  introductory  psychology  students  was  .99.  Since  all  correlations 
for  the  within-sample  categories  (time,  sex,  GPA,  and  age)  were  .92  or 
above  in  the  earlier  study  and  the  correlation  between  the  two  samples 
was  nearly  perfect,  no  further  comparison  of  within-sample  categories  was 
made. 


Scale  Ratings 

The  mean  ratings  for  each  incentive  on  the  seven-point  rating  scale 
are  shown  in  Figure  2.  "Release  from  final  examination"  was  again  the 
most  preferred,  with  a mean  rating  of  2.09.  "No  reward  at  all"  and  "assist 
ing  the  instructor  as  proctor"  were  again  least  preferred.  The  Pearson 
product-moment  correlation  between  the  scale  values  of  the  incentives 
obtained  from  the  paired-comparison  preferences  and  from  the  mean  ratings 
on  the  seven-point,  scale  was  .96,  indicating  high  consistency  between  pre- 
ferences as  assesse'd  by  the  paired  comparison  and  rating  scale  methods. 

The  Pearson  product-moment  correlation  between  the  scale  values 
obtained  from  the  present  sample  and  the  earlier  sample  of  introductory 
psychology  students  was  .98. 
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Pair-by-Pair  Preferences 
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Figure  2.  Mean  values  for  10  incentives  derived  through  rating  on  a 
7-point  scale 
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Discussion 


Scale  values  obtained  from  student  responses  to  paired -comparison 
items  and  from  student  ratings  indicate  a consistent  pattern  of  preferences 
for  the  incentives  rated  in  the  present  study.  "Release  from  final  examina- 
tion" was  the  most  preferred  incentive.  The  high  degree  of  consistency 
between  students  in  the  College  of  Education  and  students  enrolled  in  the 
required  introductory, psychology  course  indicates  consistent  preferences 
across  academic  areas. 

The  present  data  extend  the  findings  of  the  earlier  study  and  pro- 
vide instructors  with  a basis  for  the  selection  of  incentives  for  use  in 
their  courses.  Student  preferences  across  levels  and  academic  areas  indi- 
cate that  the  opportunity  to  earn  release  from  the  course  final  examination 
appears  to  be  a potentially  effective  incentive  for  motivating  students  to 
perform  well  during  the  course.  The  second  most  preferred  incentive-- 
"points  toward  the  course  grade"--could  easily  be  used  in  conjunction  with 
release  from  the  final  examination. 

Student  attitudes  toward  course-related  field  trips,  discussions 
with  an  authority  on  a class  topic,  and  recognition  in  publications  are 
of  interest  because  of  the  proportion  of  students  (22  to  30  percent)  that 
preferred  "no  reward"  to  these  incentives.  The  desirability  of  these 
incentives  may  depend  heavily  on  the  nature  of  the  field  trip,  the  eminence 
of  the  authority  or  the  nature  of  the  publication  recognition.  These 
incentives  might  be  expected  to  have  much  more  appeal  for  students  who  are 
already  interested  in  the  course  content  than  for  those  who  are  not. 

The  high  percentage  of  students  who  prefer  no  reward  to  assisting 
the  instructor  as  proctor  (41  percent)  raises  doubts  about  the  potential 
effectiveness  of  the  latter  item  as  an  incentive.  It  would  seem  prudent 
for  an  instructor  to  determine  individual  preferences  for  serving  as  a 
proctor  and/or  to  attempt  to  develop  favorable  attitudes  toward  it  before 
offering  it  as  a possible  incentive  for  high  achievement.  The  lack  of 
appeal  for  assisting  the  instructor  as  proctor  as  well  as  for  course-related 
field  trips  and  discussions  with  an  authority  may  be  related  to  the  fact 
that  the  "reward"  for  achievement  appears  to  be  an  opportunity  to  do  more 
work. 

A significant  issue  related  to  effective  instruction  is  the  extent 
to  which  available  incentives  can  be  used  to  enhance  student  achievement. 

Data  and  methodology  from  this  study  and  the  earlier  study  with  introduc^tory 
psychology  students  can  facilitate  the  selection  and  use  in  instruction  of 
incentives  that  are  most  preferred  by  students.  These  data  al^o  provide  an 
initial  base  for  selecting  preferred  incentives  to  use  in  experimental 
research  investigating  the  effects  of  such  incentives  on  student  achievement. 
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